feat(drivers): add autoindex driver #1978
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
There was a problem hiding this comment.
Pull request overview
This PR adds a new "Autoindex" driver that can crawl and parse autoindex pages (directory listings) from web servers like Apache using XPath expressions. The driver uses the antchfx/htmlquery library to parse HTML content and extract file information.
Changes:
- Added autoindex driver with configurable XPath expressions for parsing different autoindex formats
- Implemented List and Link operations for browsing and accessing files from autoindex pages
- Added size parsing utility that handles various unit formats (K, M, G, etc.)
Reviewed changes
Copilot reviewed 5 out of 6 changed files in this pull request and generated 7 comments.
Show a summary per file
| File | Description |
|---|---|
| go.mod | Added dependencies for htmlquery and xpath libraries |
| go.sum | Added checksums for new dependencies and their transitive dependency golang/groupcache |
| drivers/autoindex/util.go | Implements size parsing from human-readable strings with unit conversion |
| drivers/autoindex/meta.go | Defines driver configuration and registration with required XPath fields |
| drivers/autoindex/driver.go | Core driver implementation with List and Link methods for fetching and parsing autoindex pages |
| drivers/all.go | Registers the new autoindex driver with the driver registry |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Signed-off-by: MadDogOwner <[email protected]>
Signed-off-by: MadDogOwner <[email protected]>
Signed-off-by: MadDogOwner <[email protected]>
Signed-off-by: MadDogOwner <[email protected]>
Member
Author
有空写 |
jyxjjj
previously approved these changes
Jan 16, 2026
This was referenced Jan 16, 2026
KirCute
commented
Jan 16, 2026
xrgzs
approved these changes
Jan 17, 2026
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description / 描述
基于
antchfx/htmlquery爬取 autoindex 页面。由于各 web 服务器的 autoindex 页面各不相同，需要自己写 XPath。Motivation and Context / 背景
https://github.com/orgs/OpenListTeam/discussions/170#discussioncomment-14943992
How Has This Been Tested? / 测试
测试环境1为 Apache/2.4.18，所用参数如下：
//table/tbody/tr[position() > 2]./td[2]/a./td[3]./td[4]2006-01-02 15:04测试环境2为 nginx/1.29.0，所用参数如下：
//pre/a.substring(normalize-space(./following-sibling::text()[1]),1,17)substring(normalize-space(./following-sibling::text()[1]),19)02-Jan-2006 15:04测试环境3（本地）为 Caddy/v2.10.2，所用参数如下：
//table/tbody/tr./td[2]/a/span./td[4]/time./td[3]/div/div[2]Up01/02/2006 03:04:05 PM -07:00测试环境4（本地）为 SimpleHTTP/0.6 Python/3.11.5，所用参数如下：
//ul/li./a测试环境5响应头里只写了 Apache 没写版本，所用参数如下：
//pre/pre/a[position() > 4].substring(normalize-space(./following-sibling::text()[1]),1,16)substring(normalize-space(./following-sibling::text()[1]),18)2006-01-02 15:04Checklist / 检查清单
我已阅读 CONTRIBUTING 文档。
go fmtor prettier.我已使用
go fmt或 prettier 格式化提交的代码。我已为此 PR 添加了适当的标签（如无权限或需要的标签不存在，请在描述中说明，管理员将后续处理）。
我已在适当情况下使用"Request review"功能请求相关代码作者进行审查。
我已相应更新了相关仓库（若适用）。